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1.  INTRODUCTION 


The  problem  of  estimating  the  difference  between  means  of  a  bivariate 
normal  distribution  when  some  observations  on  either  of  the  variables  are 
missing  lias  received  a  great  deal  of  attention  in  recent  statistical  litera¬ 
ture  (c.f.  Wilks  (1932),  Anderson  (1957),  Hocking  and  Smith  (1968),  Mehta  & 
Gurland  (1969),  Lin  (1971,  1973)  and  Lin  &  Stivers  (1974)).  In  this  article 
we  study  the  problem  of  estimation  of  the  difference  between  the  location 
parameters  of  correlated  variables  from  fragmentary  samples  when  the  population 
being  sampled  is  not  necessarily  normal.  More  specifically,  let  (X,Y-0) '  be 
a  random  vector  with  absolutely  continuous  joint  distribution  function  H 

which  is  free  of  0  and  is  symmetric  in  its  arguments,  i.e.  H(u,v)  =  H(v,u)  , 

2 

for  (u,v)  e  R  .  The  marginal  distribution  function  of  X  is  denoted  by  F 

and  its  density  function  f  is  assumed  to  satisfy  the  condition  /  f2(x)dx  <  “  . 

Now,  let  (X^.Y^)  '  ,  i  =  1,  •••  ,n  be  n  pairs  of  observations  on  (X,Y) '  ; 

X  .  .  ,  j  =  1,  •  ••  ,s  ,  be  s  additional  observations  on  X  ;  Y  ,  k  =  1,  •  •  •  ,t , 
n+j  n+k  ’ 

be  t  additional  observations  on  Y  .  The  (X.,Y.)'  ,  X  and  Y  are 

i  i  n+j  n+k 

assumed  to  be  mutually  independent  for  i  =  1,  ,n  ,  j  =  1,  •••  ,s  and  k  = 

1,  •••  ,t  .  The  problem  is  how  to  use  the  fragmentary  samples  in  the  most 
efficient  way  to  estimate  the  shift  parameter  0  .  Gupta  and  Rohatgi  (1979) 
considered  the  case  that  X  and  Y  are  linearly  related  and  constructed 
regression  estimators  which  are  linear  combinations  of  fragmentary  sample  means. 
Therefore,  their  estimators  are  sensitive  to  outlying  observations. 

A  simple  and  robust  estimator  0^  of  0  is  proposed  in  Section  2.  We 
show  that  this  estimator  is  unbiased  if  the  underlying  distribution  H  is 
symmetric  about  some  point  (y^.i^) '  or  the  two  fragmentary  sample  sizes  are 

A 

equal,  i.e.,  s  *  t.  Also,  it  is  shown  that  0^  is  consistent  and 
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asymptotically  normally  distributed.  In  Section  3  we  compare  the  asymptotic 

A 

relative  efficiency  of  0^  with  other  known  estimators. 

A 

An  outstanding  feature  of  0q  is  that  it  can  be  used  even  when  the  pair¬ 
ing  of  with  ,  i  =  1,  •••  ,n  ,  cannot  be  identified  (c.f.  Hollander, 

Pledger,  and  Lin  (1974)).  For  example,  a  statewide  readiness  test  was  given 
at  the  beginning  of  the  1979-80  school  year  to  every  incoming  first  grade 
public  school  student  of  South  Carolina.  The  purpose  of  this  test  was  to  dis¬ 
tinguish  those  students  who  were  ready  for  the  formal  first  grade  curriculum 
from  those  who  were  not  ready.  A  pilot  testing  was  conducted  to  obtain  the 
cutoff  score  using  a  random  sample  of  South  Carolina's  kindergarten  students  at 
the  end  of  the  1978-79  school  year  (Garcia-Quintana  &  Huynh,  1980).  Educators 
have  constantly  demonstrated  that  in  the  very  early  years  of  schooling  a  vast 
amount  of  a  student's  achievement  is  caused  by  maturation  and  not  necessarily 
by  instruction.  This  coupled  with  the  fact  that  these  two  tests  were  conducted 
approximately  four  months  apart  establishes  a  concern  as  to  how  much  the  cutoff 
score  previously  determined  by  the  pilot  test  should  be  moved  upward.  So  the 
problem  becomes  estimating  "maturational  growth"  occurred  during  the  summer 
months.  However,  many  of  the  students  in  the  pilot  test  cannot  be  identified 
at  the  data  analysis  time  due  to  various  human  factors.  Therefore,  all  the 
parametric  and  regression  estimation  procedures  mentioned  above  are  not  valid. 

A  similar  example  was  also  cited  by  Hollander,  Pledger  and  Lin  (1974). 

2.  THE  ESTIMATOR  §Q 

For  the  fragmentary  samples  given  in  Section  1,  denote  the  ordered  set  of 
(n+s) (n+t)  differences  Yj  -  by  D(1)  <  D(2)  <  - •  *  <  D( (ttfs) (n+t) }  .  A 

natural  estimator  9^  of  6  is  then  the  median  of  the  D  's  ,  i.e., 
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(D(£)  +D(j?+1))/2  ,  (n+s)  (n+t)  =  21  , 

U(e+1)  ,  (n+s)  (n+t)  -  2)1+1  . 

A 

First,  we  consider  some  exact  small  sample  properties  of  0^  . 

A 

Theorem  1.  The  distribution  of  the  difference  0g  -  8  is  free  of  6  . 

Proof.  See  Appendix. 

A 

Theorem  2.  The  estimator  0^  is  distributed  symmetrically  about  0  if  either 
of  the  following  two  conditions  hold: 

(a)  The  distribution  H  is  symmetric  about  some  point  (p^,^)'  • 

(b)  The  two  fragmentary  sample  sizes  are  equal,  i.e. ,  s  *  t  . 

Proof.  See  Appendix. 

A 

This  theorem  shows  that  under  the  stated  conditions,  the  estimator  6q  is 

A 

unbiased.  Now,  let  us  consider  the  asymptotic  performance  of  0^  . 

Theorem  3.  Let  N  ■  2n  +  s  +  t  and  be  nonnegative  numbers  such  that 

Aj  +  >  0  ,  A^  +  A^  >  0  and  A^  +  +  2A^  *  1  .  Then,  as  N  °°  , 

s/N  -*■  Aj  ,  t/N  ■*  A^  ,  n/N  -*■  A^  ,  the  distribution  of  N1s(8q-0)  converges  to 
a  normal  distribution  with  mean  0  and  variance 

°§Q  *  [j2+A3(|-2/F(u)F(v)dH(u,v))]  /[(A3  +  A1)(A3+A2)(/  f2(v)dv)2J  . 
Proof.  See  Appendix. 

A 

The  above  theorem  also  shows  that  6q  is  consistent.  We  note  that  the 
computation  of  0^  requires  finding  the  median  of  the  ((n+s) (n+t))  differences 
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Yj  -  X^  and  becomes  rather  tedious  for  a  large  set  of  data.  Fortunately,  there 
are  several  shortcut  methods  of  obtaining  00  (c.f.  Lehmann  (1975),  p.  83). 

3.  THE  EFFICIENCY  OF  0Q 

A  /V 

The  estimator  80  is  compared  with  the  Lin-Stivers  estimator  9^  (c.f. 

A 

(2.4)  of  Lin  &  Stivers  (1974)),  a  regression  estimator  8^  (c.f.  (9)  of  Gupta 

/s  _  _  _  n+t 

&  Rohntgi  (1979))  and  a  naive  estimator  0^  =  Y -  X  ,  where  Y  =  ^Z^  Y^/(n+t) 
n+s 

and  X  =  Z  X,/(n+s)  .  All  the  estimators  mentioned  above  are  consistent  and 
i=l  1 

asymptotically  normally  distributed. 

A  A  A  A 

The  relative  efficiency  of  two  estimators  0  =  6(N)  and  0'  =  0'(N')  of 
0  is  defined  as  the  ratio  of  sample  sizes  N  and  N'  required  for  the  esti¬ 
mators  to  have  the  same  probability  of  falling  within  a  stated  distance  of  0  , 
i.e.,  for  a  fixed  constant  b  , 

PQ(  1 6(N) -0|  <b)  =  F0(|0'(N’)  -9|  <b)  .  (3.1) 

A 

However,  this  approach  creates  a  problem  in  the  large  sample  case.  If  8 

A 

and  O'  are  consistent  estimators  of  0  ,  then  the  limiting  probability  in 
(3.1)  of  both  estimators  is  1  .  Thus  it  is  impossible  to  use  this  probability 

A  A 

to  provide  a  meaningful  comparison  between  0  and  9'  asymptotically.  To 
overcome  this  difficulty,  we  propose  the  following  definition  of  the  asymptotic 
relative  efficiency  of  estimators. 

/V  A 

Definition  1.  Let  (0(N^)}  and  (0'(N£)}  be  two  sequences  of  estimators  for 
estimating  0  .  Let  (0 ± b  }  be  a  sequence  of  intervals  such  that  lim  b,  * 

K  ■+■  oo  K 

0  .  In  addition,  let  8g(k)  -  P0(| 8(Nk)  -  9 1  <  b^)  and  8g,(k)  - 

Pp ( 1 8 ' (N£)  -  8 1  <  b^)  .  Also,  let  {N^}  and  {N^}  be  Increasing  sequences  of 

positive  integers  such  that  the  two  sequences  of  estimators  have  the  same 
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limiting  B  value,  i.e.,  lim  B^(k)  =  lim  B~,(k)  .  Then  the  asymptotical 

^  oo  U  oo  U 

relative  efficiency  (ARE)  of  (0)  and  {O'}  is 

ARE(6,0')  =  lim  (N^/N  )  , 

k  00 

provided  that  this  limit  is  the  same  for  all  such  sequences  Cn^}  and 
and  independent  of  the  {0 ± b^}  sequence. 

Although  there  is  no  explicit  statement  concerning  the  rate  of  convergence 

of  the  sequence  {b  }  in  the  above  definition,  we  are  particularly  interested 

in  the  sequence  {0  ±  b^}  with  b^  *  a/»|/N^  =  a'/v1^  ,  where  a  and  a'  are 

some  fixed  constants.  If  both  random  variables  i/N^(0-0)  and  are 

2  2 

asymptotically  normally  distributed  with  mean  0  and  variances  a g  and  Og,  , 

~  a  2  2 

respectively,  then  it  can  be  shown  that  ARE(6,0')  ■  Og,  /og  which  is  the 

A  A 

conventional  definition  of  ARE  of  estimators  0  and  0'  provided  that 
lim  «4l.  (0-0)  =  op"  and  lim  ( 9 * — 0)  ■  02?  (c.f.  Randles  and  Wolfe 

(1979),  p.  227). 

Several  bivariate  distributions  were  considered  for  H  in  the  comparison 
study : 

(a)  A  bivariate  normal  distribution  with  unit  variances  and  correlation 
coefficient  p  . 

(b)  A  bivariate  logistic  distribution  (Gumbel  (1961)).  The  joint  distri¬ 
bution  function  is 

H(u,v)  -  F(u)F(v)|l  +  a|l-F(u))  { l-F(v) )  j  , 

where  -1  <  «  <  1  ,  F(u)  ■  (1  +  e  u)  *  ,  and  the  correlation  coeffi- 
2 

cient  p  ■  3a/n 
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(e)  A  bivariate  exponential  distribution  (Gumbel  (I960)).  The  joint 
distribution  function  is 

H(u,v)  =  F(u)F(v)  j  1  +  a  ^1-F(u)^l-F(v)^  j  ,  where 

F(u)  =  1-e  U  and  the  correlation  coefficient  p  =  a/4  . 

The  advantage  of  using  Gumbel 's  bivariate  distributions  for  our  comparison 

2  * 

study  is  that  the  asymptotic  variance  erg  of  6^  in  Theorem  3  has  a  closed 
form.  For  each  family  of  bivariate  distributions  mentioned  above  and  a  group 
of  selected  values  of  p  ,  the  asymptotic  relative  efficiencies  e^  = 

ARE(0q,0.)  ,  i  =  1,2,3,  were  computed.  Table  1  provides  the  computational 

/\ 

results  for  =  .1  ,  ^2  *  an<i  ^3  ”  **  •  Compared  with  0^  ,  i  =  1,2,3, 
0^  does  mucli  better  for  heavy  tail  distributions  as  is  to  be  expected  because 
0^  (i  *  1,2,3)  is  a  linear  combination  of  fragmentary  sample  means.  In  partic¬ 
ular,  if  H  is  a  bivariate  Cauchy  distribution  (c.f.  Johnson  &  Kotz  (1976), 
p.  295)  which  is  not  shown  in  Table  1,  the  ARE(0g,0^)  ■  00  ,  i  *  1,2,3  .  For 

A  A 

normal  and  logistic  distributions,  0^  performs  as  well  as  0^  (i  «  1,2,3) 
except  for  large  values  of  p  . 

Results  similar  to  Table  1  were  also  found  for  other  combinations  of  , 

i  *  1,2,3.  Here,  we  only  report  a  case  when  there  is  a  large  fraction  of 
missing  observations  in  the  data  (see  Table  2). 

4.  APPENDIX 

A 

Proof  of  Theorem  1.  The  error  of  estimator  0^-0*  med  (Y^-X^)  -  0  can  also 
be  written  as  med(Yj-9-X^)  .  Since  the  joint  distribution  of  (X^,Yj-8)'  , 

X^  ,  and  Y^-  8  ,  i  -  1,  •  •  •  ,n  ,  j  *  1,  •  *  •  ,a  ,  k  -  1,  •  •  •  ,t  is  free  of 

A 

6  ,  the  same  is  true  for  the  distribution  of  0q  -  0  . 
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Proof  of  Theorem  2.  By  Lemma  1,  for  any  real  number  a  ,  Pq(0q-0<3)  = 

P^(0^<a)  .  Without  loss  of  generality,  we  can  assume  that  0  =  0. 

(a)  Since  H  is  symmetric  in  its  arguments,  =  f  •  Also,  since 

CL  =  med(Y  -X.)  ,  we  can  assume  that  p  =  0  .  It  follows  that 
0  1  i 

(X.,Y  )'  ,  X  .  ,  and  Y  ,,  have  the  same  joint  distribution  as 
l  i  n+j  n+k 

(-W'  •  -Vr  and  -V*>  1  ‘ 

A  A 

k  =  1,  •••  ,t  .  This  implies  that  0Q  and  -0Q  have  the  same  distri- 

/A 

bution  and  0^  is  symmetric  about  0  . 

(b)  If  s  =  t  and  0=0,  then  (X^YJ  »  xn+j  *  and  Yn+k  have  the 

same  joint  distribution  as  (Yi,Xj^  »  Yn+j  ’  and  Xn+k  ’  *  =  1*  »n  > 

A  A 

j , k  =  1,  •••  ,s  .  Hence,  0Q  and  -0Q  have  the  same  distribution. 

Two  lemmas  are  needed  to  prove  Theorem  3.  First,  let  us  define  a  scoring 

function  <t>  for  comparing  two  observations  X^  and  Yj  by 


Lemma  1 .  For  any  real  number  a  and  integer  i  between  1  and  (n+s) (n+t)  , 

the  it*1  ordered  difference  D,..  <  a  if  and  only  if  Wv  v  i  (n+s)  (n+t)  -  i  . 

(i)  X ,Y-a 

Proof .  C.  f.  Theorem  4  of  Chapter  2,  p.  87,  of  Lehmann  (1975). 

Lemma  2.  For  0=0  and  a  positive  real  a  ,  the  distribution  of 

((n+s) (n+t)N)~  i  (wx  Y _ a//$  -  (n+s) (n+t)?1)  converges  to  a  normal  distribution 

2 

with  mean  0  and  variance  H  “  1/12+  J  F(u)F(v)dH(u,v))  ,  as  N  -*■  00  , 
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s/N  -*•  X  ,  t/N  ,  n/N  -*■  A^  ,  where  p ^  =  /  F(u  +  a/i/N)dF(u)  and  F(*)  = 

1  -  F( • )  . 

Proof .  For  convenience,  let  us  define  a  sequence  of  fragmentary  samples 

(Xl,m’Yl,m) '  ’  ‘ * '  *  (Xn  ,m,Yn  ,m) '  !  Xn  +l,m  ’  ‘ ' ’  ’  Xn  +s  ,m  ;  Yn  +l,m  ’  "  ‘  ’ 

*  m  m  m  mm  m 

Y  ,  where  (X  ,Y  +  a/v^~ ) 1  has  distribution  function  H  , 

n  +L  ,m  i,m  i,m  m 

m  m 

(i  =  1,  •••  ,n  ,  N  =  2n  + s  + t  )  ,  X.  and  Y.  have  distribution  func- 
m  m  m  m  m  i,m  j  ,m 

tions  F(x)  and  F(y  +  a//fi~ ),  i  *  1,  •  •  •  ,n  +  s  ,  i  =  1,  •  •  •  ,n  +  t  , 

m  mm  mm 

respectively,  and  s/N  -*■  A,  ,  t  /N  -*•  X„  ,  n/N  X  ,  as  m  -*•  00  . 
r  mm  1mm  2  mm  3 

Furthermore,  we  assume  that  (X.  ,Y .  )'  ,  X  .  ,  and  Y  .  are 

i.m  i,m  njn+j  ,m  i^+k.m 

mutually  independent  for  i  =  1,  ••*  ,n  ,  j  =  1,  •••  ,s  , 

m  m 

k  =  1 ,  •  •  •  ,t  and  (X,  ,Y,  ) '  =  (U,V  -  a/t^T" ) '  ,  m  >  1  ,  where  (U,V) '  has 

m  i ,m  i ,m  m 

distribution  function  H  . 


r,  let  p,  =  /  F(u +  a/v'SH) dF(u) 

I  y  m  m 


n+s  n  +  t 
,  m  m  mm 


p  .  m  in  hi  in  \ 

((n+s  )(n+t  )N  )  (  y  y  (<HX.  ,Y  )  -  P.  ))  , 

\mm  m  m  m  /  \  ^  ^  \  i,m  j  ,m  l,m  // 


i=i  j=i 


n+s 

k;  .  m  m 


*  =  (r-Ar  VY  I  (?<xi  +•/««")-**!  ))  + 

m  \  (n +s  )N  /  l  Z-i  '  i.m  m  l,m// 

\  m  m  m  /  \  ’ 


'  n  +s 
m  m 

(n  +  t  )N 
i  m  m  m 


,  n  +t 
\  .  m  m 


)(sWo). 


S'V.'V*  - 
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Then,  it  follows  from  the  argument  provided  by  Hollander,  Pledger  and  Lin  (1974, 
p.  179)  that 


n  +  s  n  +t 


((n+s  )  ( n  + 1  )N 
\  m  m  m  m  m 


.  m  m  m  m 

)"'E(S  I  8<Xi,«'Yj  .m’)' 

i=l  j=l  ' 


£  j1- 

as  m  -+  00  .  Thus,  W  and  T  ‘  have  the  same  limiting  distribution. 

mm 

To  show  that  T  is  asymptotically  normal,  we  rewrite  as  the  sum 

of  three  independent,  normalized  sums  of  bounded  random  variables: 


* 


n  +t 
m  in 

(n  +  s  )N 
m  m  m 


n 

U  m 


y  (  F(X,  +a/^ )  -P.  W 
\  i,m  m  l,m/ 


i=l 


n  +s 
m  m 

(n+t  )N 
m  m  m 


1  h 


LI 

y  (f<y.  >-p.  )>+ 

\  i,m  l,m/| 
i=l  1 

J 


n  +  t 
m  m 

(n+s  )N 
m  m  m 


n  +s 

Sj  m  m 


11  111  \ 

y  (f(X.  +  aMT )  -  P  )> 

ZZ  '  i,m  m  1  ,m '  | 

-i-1  ' 


i=n  +1 
m 


n+s 
m  m 

(n+t  )N 
m  m  m 


n  +t 

-i  m  m 


y  (f(y.  >  -  p. 

Z-.  '  j,m  l,r 


j=n  +1 
m 


The  asymptotic  normality  of  each  separate  sum  in  follows  from  a  version 

of  Ber ry-Esseen  Theorem  (c.f.  Chung  (1968),  Theorem  7.1,2.,  p.  185).  The 

asymptotic  variance  of  T  *  can  be  obtained  through  the  fact  that  (X,  ,Y  )'= 

m  l,m  l,m 

(U.V-a/ZN-)'  ,  m  >  1  and  (U,V)'  has  distribution  H  . 
m 

L  A. 

Proof  of  Theorem  3.  By  Lemma  1,  for  any  real  a  ,  Pq (N  (0-9)  <  a)  * 

P()(N29<a)  -  Pq(0  <  a//N)  .  Without  loss  of  generality,  we  can  assume  that 

9=0.  Consider  first  the  case  (n+s)  (n+t)  =  2)1+1.  By  Lemmas  2  and  3  and 
<1 

the  fact  that  J  f  (v)dv  <  ^  (c.f.  Olshen  (1967)  and  Mehra  &  Sarangi  (1967)), 


]0 


(n+s)  (n+t)  +  1 
2 


1  P0j(w«> <"«>»)■'■  (“x.y-.MT  <"+s)(”+t)''l)s  L<- ■«"  -  1  ’  [«'*(£ 
/  F(u+a/v/N)dF(u))J  j  - ►  $(a(A3+X1)1'5(X3+X2)1'5  /  f2(v)dv/n)  , 


as  N  •*  00  ,  s/N  X^  ,  t/N  -*■  X2  ,  n/N  -*■  X 3  ,  where  $  is  the  distribution 
funot ion  of  N(0, 1)  . 

In  the  case  (n+s)(n+t)  =  2i  ,  the  probability  P^(0  <a//N)  is  bounded 
below  and  above  by  Po^D(P+l)  “  and  <  a/’2N)  •  BY  the  same  argu¬ 

ment  ,  it  can  be  shown  that  these  two  probabilities  have  the  same  limiting 

,  ./  x  .i  , ,*5  r  ,2,  ,  ,  ,\ 


> i no  :  (an  J+'1)5(>3+x2)'l/f  (v)Jv/n)  . 
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TABLE  1.  THE  ASYMPTOTICAL  RELATIVE  EFFICIENCY  ei  ,  i  =  1,2,3. 


<A1 

.i  x2  = 

a  x3 

=  .4) 

Correlation 

Coefficient 

P 

Bivariate 

normal 

el  e2 

e3 

THE  DISTRIBUTION  H 

Bivariate 

logistic 

el  e2 

e3 

Bivariate 

exponential 

61  e2  e3 

-.8 

.91 

.91 

96 

1.00 

1.00 

1.05 

3.26 

3.26 

3.45 

-.6 

.93 

.93 

96 

1.03 

1.03 

1.06 

3.26 

3.25 

3.36 

-.4 

.95 

.95 

96 

1.05 

1.06 

1.07 

3.21 

3.22 

3.26 

-.2 

.96 

.96 

96 

1.08 

1.08 

1.08 

3.13 

3.14 

3.14 

0.0 

.96 

.96 

95 

1.10 

1.10 

1.10 

3.00 

3.02 

3.00 

_  2 

.94 

.95 

95 

1.11 

1.12 

1.12 

2.80 

2.82 

2.82 

.4 

.90 

.91 

94 

1.10 

1.11 

1.15 

2.49 

2.51 

2.59 

.6 

.81 

.82 

93 

1.05 

1.06 

1.20 

2.01 

2.02 

2.29 

.8 

.61 

.62 

93 

.88 

.88 

1.32 

1.25 

1.25 

1.88 
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TABLE  2.  THE  ASYMPTOTICAL  RELATIVE  EFFICIENCY  e  ,  i  =  1,2,3. 
(\1  =  .2  A2  =  .2  A3  =  .3) 


THE  DISTRIBUTION  H 


Correlation  Bivariate 

Coefficient  normal 


Bivariate 

logistic 


Bivariate 

exponential 


p 

e! 

e2 

e3 

el 

e2 

e3 

G1 

e2 

e3 

-.8 

.88 

.89 

.96 

.98 

.98 

1.06 

3.10 

3.11 

3.36 

-.6 

.91 

.93 

.96 

1.01 

1.03 

1.07 

3.12 

3.17 

3.29 

-.4 

.94 

.96 

.96 

1.05 

1.08 

1.08 

3.12 

3.21 

3.21 

-.2 

.93 

.99 

.96 

1.08 

1.12 

1.09 

3.09 

3.22 

3.11 

0.0 

.95 

1.01 

.95 

1.10 

1.16 

1.10 

3.00 

3.16 

3.00 

.2 

.94 

1.00 

.95 

1.10 

1.17 

1.11 

2.84 

3.01 

2.87 

.4 

.89 

.94 

.94 

1.06 

1.13 

1.13 

2.55 

2.71 

2.71 

.6 

.77 

.82 

.94 

.95 

1.01 

1.16 

3.08 

2.19 

2.53 

.8 

.53 

.55 

.94 

.68 

.71 

1.20 

1.30 

1.34 

2.29 
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